Modality Switch Effects Emerge Early and Increase throughout Conceptual Processing: Evidence from ERPs
نویسندگان
چکیده
We tested whether conceptual processing is modality-specific by tracking the time course of the Conceptual Modality Switch effect. Forty-six participants verified the relation between property words and concept words. The conceptual modality of consecutive trials was manipulated in order to produce an Auditory-to-visual switch condition, a Haptic-tovisual switch condition, and a Visual-to-visual, no-switch condition. Event-Related Potentials (ERPs) were time-locked to the onset of the first word (property) in the target trials so as to measure the effect online and to avoid a within-trial confound. A switch effect was found, characterized by more negative ERP amplitudes for modality switches than noswitches. It proved significant in four typical time windows from 160 to 750 milliseconds post word onset, with greater strength in posterior brain regions, and after 350 milliseconds. These results suggest that conceptual processing may be modality-specific in certain tasks, but also that the early stage of processing is relatively amodal.
منابع مشابه
Exploring Modality Switching Effects in Negated Sentences: Further Evidence for Grounded Representations
Theories of embodied cognition (e.g., Perceptual Symbol Systems Theory; Barsalou, 1999, 2009) suggest that modality specific simulations underlie the representation of concepts. Supporting evidence comes from modality switch costs: participants are slower to verify a property in one modality (e.g., auditory, BLENDER-loud) after verifying a property in a different modality (e.g., gustatory, CRAN...
متن کاملConceptual Flexibility in the Human Brain: Dynamic Recruitment of Semantic Maps from Visual, Motor, and Motion-related Areas
Traditionally, concepts are assumed to be situational invariant mental knowledge entities (conceptual stability), which are represented in a unitary brain system distinct from sensory and motor areas (amodality). However, accumulating evidence suggests that concepts are embodied in perception and action in that their conceptual features are stored within modality-specific semantic maps in the s...
متن کاملSwitching Modalities in A Sentence Verification Task: ERP Evidence for Embodied Language Processing
In an event related potential (ERP) experiment using written language materials only, we investigated a potential modulation of the N400 by the modality switch effect. The modality switch effect occurs when a first sentence, describing a fact grounded in one modality, is followed by a second sentence describing a second fact grounded in a different modality. For example, "A cellar is dark" (vis...
متن کاملIntermodal Auditory, Visual, and Tactile Attention Modulates Early Stages of Neural Processing
We used event-related potentials (ERPs) and gamma band oscillatory responses (GBRs) to examine whether intermodal attention operates early in the auditory, visual, and tactile modalities. To control for the effects of spatial attention, we spatially coregistered all stimuli and varied the attended modality across counterbalanced blocks in an intermodal selection task. In each block, participant...
متن کاملCrossmodal links in spatial attention between vision, audition, and touch: evidence from event-related brain potentials.
Results from event-related potential (ERP) studies are reviewed that investigated crossmodal links in spatial attention between vision, audition and touch to find out which stages in the processing of sensory stimuli are affected by such crossmodal links. ERPs were recorded in response to visual, auditory, and tactile stimuli under conditions where attention was directed to a specific location ...
متن کامل